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Remarks/Argu ments : 

This Response adds no new claims, and does not amend any claims. No new matter 
has been added. Upon entry of this Response, claims 1-20 will be pending. Claims 1, 7, 9, 
10, 11, 17, 19 and 20 are independent. 

Rejections of the Claims under 35 U.S.C. 103 

The Examiner has rejected claims 1, 7-11 and 17-20 under 35 U.S.C. 103(a) as being 
unpatentable over the publication entitled "Extraction Of Photographic Area From Document 
Images" of Osamu Nakamura et al. (hereinafter Nakamura) in view of U.S. Patent No. 
5,212,741 of Barski et al. (hereinafter Barski). 

As discussed in further detail below, the Nakamura reference does not disclose an 
edge enhancement part for enhancing edges of a character block classified previously by the 
block classification part, nor the generation of a threshold to then be used for binarizing 
pixels. That is, the Nakamura reference does not disclose a system and method wherein 
block classification is completed prior to the edge enhancement, nor the generation of a 
threshold to then be used for binarizing pixels. The Nakamura reference describes a system 
and method wherein edge factors are used as a factor in segmentation, which does not 
describe segmentation followed by edge enhancement and then binarization as recited by the 
Applicants. 

Further, the Barski reference preprocesses only a portion of character blocks, and 
further simply provides the mask of Fig. 8 to determine edge information and relies upon 
numerous pre-processing steps for a binarization threshold value. Accordingly, neither the 
Nakamura or Barski references, separately or in combination, describe the edge enhancement 
part as recited by the Applicants. 

The Examiner points to Nakamura as disclosing a system and method for binarizing 
an image having an input part for receiving an image, a block classification part for dividing 
the received image into blocks and classifying the divided blocks into character blocks and 
background blocks, a block growing part for growing the classified character blocks and 
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restoring blocks containing a character pixel, classified as a background block, to character 
blocks, a block grouping part for grouping a character block output from the block growing 
part with its neighboring blocks thereby generating a grouped block, a block splitting part for 
separating the character block from the grouped block, and a binarization part for binarizing 
pixels of the separated character blocks into a first brightness value for character pixels and a 
second brightness value for background pixels by comparing the pixels of the separated 
character blocks with a threshold, and binarizing pixels of a background block output from 
the block growing part into the second brightness value. 

The Examiner points to Nakamura as further disclosing an edge enhancement part for 
use in classification and as such, not for use on the image subsequent to classification as 
recited by the Applicants. The Examiner points to Nakamura as still further disclosing a 
binarization part for binarizing pixels, but without the use of the threshold established during 
the edge enhancement stage as recited by the Applicants. 

The Examiner points to Barski as disclosing an edge enhancement part for enhancing 
edges of the character block using relations between pixels in the grouped block, and 
generating a threshold for distinguishing character pixels and background pixels of the 
character block to be used in binarizing pixels of background blocks output from the block 
classification part into the second brightness values, purportedly anticipating the invention as 
recited by the Applicants. 

The Nakamura reference describes a method for improved photographic area 
segmentation accuracy by using an extraction algorithm. The proposed extraction algorithm 
uses the characteristics of both edge elements and background gray levels. The method first 
extracts photographic areas using an extraction algorithm, and then blocks that are judged as 
being two-valued areas (described in greater detail below) are quantized and transformed into 
black and white using a notchless bi-level quantization. 

For segmentation of the photographic area prior to the notchless bi-level quantization, 
the extraction algorithm notes that gray level changes are more frequent in textual parts (e.g., 



13 



Application No. 10/767,061 

Response dated June 27, 2008 

Reply to Office Action of March 28, 2008 

two-valued areas) than those of photographic areas (e.g., candidate areas) (see page 77, Part 
2, first paragraph of the Nakamura reference). Accordingly, three steps are performed. 

First, a derivative histogram is used to determine an upper threshold value T s to 
decide what are two-valued areas, and what are candidate areas. 

Second, for the two-valued areas only, a ratio T e is determined, and for the candidate 
areas only, a ratio W g is determined, and the two are compared for each candidate area block 
to determine if any candidate area blocks are to be converted to two-valued areas. However, 
the process can be reversed such that converted blocks can be returned to a candidate area 
again using ratios of each (see page 78, Equation (7)). Still further, candidate areas can be 
reclassified as two-valued areas using a positional relationship (see page 79, Part 5). 

Third, for the candidate areas only of the first and second steps, the adjacent eight 
blocks of each candidate area are combined and still further expanded by one block width on 
each side and then divided into sub blocks, and elements of the first and second steps are then 
repeated. The final widened and integrated areas are considered the final potential candidate 
areas (see page 79, Part 4), and the final two-valued areas are quantized and transformed into 
black and white pictures (see page 80, Part 3). In doing so, the Nakamura reference describes 
a system for the bi-level quantization of the two-valued areas (e.g., textual parts) as 
segmented by the above three steps, resulting in the images shown in Nakamura Fig. 9 (see 
page 80). 

The Nakamura reference describes a system for the segmentation and bi-level 
quantization of photographic areas, and the Examiner points to the Nakamura reference as 
disclosing a method and device for binarizing an image as recited by the Applicants. In 
regard to the input part, the Examiner points to the input image of Nakamura Fig. 1, and in 
regard to the block classification part, the Examiner points to at least the first step of the 
Nakamura segmentation as described above. 

In regard to the edge enhancement part, the Examiner points to Nakamura as 
disclosing an edge enhancement part for use in classification and as such, not for use on the 
image subsequent to classification as recited by the Applicants, and points to Barski as 
disclosing such an edge enhancement part for enhancing edges of the (classified) character 
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block using relations between pixels in the grouped block and generating a threshold for 
distinguishing character pixels and background pixels of the character blocks to be used in 
binarizing pixels. 

More specifically, in regard to the edge enhancement part as recited by the 
Applicants, the Nakamura reference describes the calculation of ta, which is used in the 
second step described above to separate the two-valued areas and candidate areas (see page 
78, Equation (2)). To determine ta, the Nakamura reference describes the use of a number Q 
of edge elements to first determine a percentage of edge elements to the total number of 
pixels (see page 81, last paragraph), plotted and from which, a value ta is determined. In the 
calculation of ta, edge pixels are considered in a ratio relation for purposes of designating 
two-valued areas and candidate areas (see Nakamura Fig. 13 and page 78, Equation (2)). 

In contrast, the Applicants recite an edge enhancement part which enhances edges of 
the character blocks previously classified by the block classification part. That is, to avoid 
adverse effects when an image includes an irregularly lighted subject, the block classification 
is performed prior to edge enhancement (see page 3, lines 4-6, and Figs. 2-5). In doing so, 
edge enhancement is performed upon character blocks previously classified by the block 
classification part, followed by binarization of the separated blocks. 

In the first and second steps of the Nakamura reference, a derivative histogram is used 
to determine a value T s to decide what are two-valued areas and what are candidate areas, and 
for the two-valued areas only, a ratio T e is determined, and for the candidate areas only, a 
ratio W g is determined and the two are compared for each candidate area block to determine 
if any candidate area blocks are to be converted to two-valued areas. However, this 
separation of areas is not performed prior to the steps as discussed in Nakamura Part 4, but 
are performed together. That is, the edge factor discussion of Nakamura Part 4 results in the 
value ta, which is used in the second step described above to separate the two-valued areas 
and candidate areas (see page 78, Equation (2)). Accordingly, the steps of Nakamura Part 4 
are integral to the area separation and are not performed after area separation. 



15 



Application No. 10/767,061 

Response dated June 27, 2008 

Reply to Office Action of March 28, 2008 

Accordingly, the Nakamura reference does not disclose an edge enhancement part for 
enhancing edges of a character block classified previously by the block classification part, 
nor the generation of a threshold to then be used for binarizing pixels. That is, the Nakamura 
reference does not disclose a system and method wherein block classification is completed 
prior to the edge enhancement, nor the generation of a threshold to then be used for 
binarizing pixels. The Nakamura reference describes a system and method wherein edge 
factors (of Part 4) are clearly used as a factor in segmentation, which does not describe 
segmentation followed by edge enhancement and then binarization as recited by the 
Applicants in each of independent claims 1, 7, 9, 10, 11, 17, 19 and 20. 

In response to the Applicants' previous reply, the Examiner points to newly cited 
Barski as disclosing an edge enhancement part for enhancing edges of the character block 
using relations between pixels in the grouped block (that is, disclosing an edge enhancement 
part for enhancing edges of a character block classified previously by the block classification 
part), and for generating a threshold for distinguishing character pixels and background pixels 
of the character block to be used in binarizing pixels of background blocks output from the 
block classification part into the second brightness values. 

The Barski reference describes a system and method for identifying specific test 
applications (i.e., dot matrix) and if detected, performing pre-processing prior to binarization 
(see steps 10, 20 and 30 of Fig. 1). To do so, a histogram is first prepared followed by 
smoothing, contrast stretching, and edge enhancements steps (see steps 24, 26 and 28), prior 
to binarization. 

However, Barski does not describe the edge enhancement of all character blocks. As 
seen in the flow chart of Barski Fig. 1, a determination is first made at step 10, and only text 
comprising dot-matrix or ink-jet printed text is pre-processed as noted by step 20. Regular 
text is binarized without pre-processing (see step 16 of Fig. 1, and col. 4, lines 18-26). 

Further, it is not clear that the Barski reference describes the edge enhancement part 
for enhancing edges of the character block using relations between pixels in the grouped 
block. The Barski reference appears to use a mask of Fig. 8 as moved across the image to 
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display edge information (see col. 6, lines 63-68 to col. 7, lines 1-5) and primarily, bring out 
the higher frequency line detail and eliminate dots. It is unclear how this describes the 
enhancement of edges of a character block using relations between pixels in a grouped block 
prior to binarization. 

The Examiner further points to Barski as disclosing the edge enhancement part for 
generating a threshold for distinguishing character pixels and background pixels of the 
character block to be used in binarizing pixels of background blocks output from the block 
classification part into the second brightness values. 

However, in regard to the binarization of step 16, no data from the pre-processing 
steps 20 is used (see again Fig. 1, and col. 4, lines 20-29). Further, the binarization of step 30 
uses a threshold density value resulting from combined pre-processing steps of smoothing, 
contrast stretching, and edge enhancements prior to binarization (see col. 7, lines 20-28). 
That is, the edge enhancement step 28 is not solely relied upon for a threshold value. 

Accordingly, as the Barski reference describes a system and method that preprocesses 
only a portion of character blocks, and further simply provides the mask of Fig. 8 to 
determine edge information, and still further relies upon numerous pre-processing steps for a 
threshold value, the Barski reference fails to disclose the edge enhancement part and method 
of operation thereof as recited by the Applicants in each of independent claims 1, 7, 9, 10, 1 1, 
17, 19 and 20. 

For these reasons, the Applicants assert that the Nakamura and Barski references do 
not disclose or reasonably suggest each element as recited by the Applicants in independent 
claims 1, 7, 9, 10, 1 1, 17, 19 and 20, and the Applicants respectfully request the withdrawal 
of the rejection under 35 U.S.C. 103(a). 
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Regarding claims 8 and 18, the Examiner, in addition to the reasons stated above, 
further points to Nakamura in view of Barski as disclosing a block growing part having a 
dilation part for growing a character block and changing a block containing a character pixel, 
classified as a background block, to a character block, and a closing part for eroding the 
dilated character block and deducting connected blocks, purportedly rendering obvious the 
invention as recited by the Applicants in claim 8, and a method thereof as recited by the 
Applicants in claim 18. 

However, for the reasons stated above, the Applicants assert that the Nakamura and 
Barski references do not disclose or reasonably suggest each element as recited by the 
Applicants in independent claims 7 and 17, from which claims 8 and 18 depend. 
Accordingly, the Applicants respectfully request the withdrawal of the rejection under 35 
U.S.C. 103(a) of dependent claims 8 and 18 for the same reasons. 

The Examiner has rejected claims 2, 3, 6, 12, 13 and 16 under 35 U.S.C. 103(a) as 
being unpatentable over Nakamura in view of Barski, and further in view of the publication 
entitled "Adaptive, Quadratic Preprocessing Of Document Images For Binarization" of Shan 
Mo et al. (hereinafter Mo). 

Regarding dependent claims 2, 6, 12 and 16, the Examiner, in addition to the reasons 
stated above, further points to Nakamura and Barski as disclosing an edge enhancement part 
and points to Mo as disclosing a system and method having a first threshold selection part for 
calculating a first threshold for classifying each pixel of the character block as a character 
pixel or a background pixel, a mean computation part for classifying pixels of the character 
block into character pixels and background pixels on the basis of the first threshold, and 
calculating mean brightness values for character pixels and background pixels of the 
character block, a normalization part for normalizing pixels of the character block using the 
mean brightness value for character pixels and the mean brightness value for background 
pixels output from the mean computation part so that the character pixels have a value close 
to 'T while the background pixels have a value close to '0', a quadratic operation part for 
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performing a quadratic operation on the normalized character block so as to enhance edges of 
the character block and reduce noise of the character block, a denormalization part for 
denormalizing the quadratic-processed character block and providing the denormalized 
character block to the binarization part, and a second threshold selection part for calculating a 
second threshold for classifying pixels into character pixels and background pixels, by 
normalizing the first threshold, and outputting the second threshold as a threshold for the 
binarization part and method thereof, purportedly rendering obvious the invention as recited 
by the Applicants in claims 2, 6, 12 and 16. 

Regarding claims 3 and 13, the Examiner points to Nakamura and Barski as 
disclosing the claimed invention with the exception of the quadratic filter of the edge 
enhancement portion. The Examiner points to Mo as disclosing such a quadratic filter, 
purportedly rendering obvious the invention as recited by the Applicants in claims 3 and 13. 

The Mo reference describes a system and method for an adaptive algorithm for pre- 
processing document images prior to binarization. The Mo reference recognizes that edge 
enhancement and noise reduction is desirable before binarization, and that normalization is 
desirable even before pre-processing. To do so, the Mo reference describes the use of a 
normalization step prior to the adaptive pre-processing algorithm (see page 995, Equation 
(7)). However, the Mo reference fails to describe the normalization and pre-processing 
algorithm arrangement as a block classification for the classification of both character and 
background blocks and from which, only character blocks are edge enhanced. That is, the 
Mo reference fails to disclose an edge enhancement part for enhancing edges of a character 
block classified previously by the block classification part as recited by the Applicants. 

For these reasons, the Applicants assert that the Nakamura, Barski and Mo references 
do not disclose or reasonably suggest each element as recited by the Applicants in 
independent claims 1 and 11, from which claims 2, 3, 6, 12, 13 and 16 depend, and the 
Applicants respectfully request the withdrawal of the rejection under 35 U.S.C. 103(a) of 
dependent claims 2, 3, 6, 12, 13 and 16 for the same reasons. 
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The Examiner has rejected claims 4, 5, 14 and 15 under 35 U.S.C. 103(a) as being 
unpatentable over Nakamura in view of Barski, and further in view of the publication entitled 
"Fast Segmentation Of The JPEG Compressed Documents" of de Queiroz et al. (hereinafter 
de Queiroz). 

Specifically, regarding claims 4 and 14, the Examiner points to Nakamura and Barski 
as disclosing the claimed invention with the exception of a discrete cosine transformation 
block and the use of an energy calculation for region classification. The Examiner points to 
de Queiroz as disclosing such a discrete cosine transformation block and the use of an energy 
calculation for region classification, purportedly rendering obvious the invention as recited by 
the Applicants in claims 4 and 14. 

Regarding claims 5 and 15, the Examiner points to de Queiroz as disclosing the block 
size and energy calculation, purportedly rendering obvious the invention as recited by the 
Applicants in claims 5 and 15. 

The de Queiroz reference describes a system and method for the segmentation of 
JPEG-compressed images without decompression. However, as with the Nakamura and 
Barski references, the de Queiroz reference does not disclose an edge enhancement part for 
enhancing edges of a character block classified previously by the block classification part. 

For these reasons, the Applicants assert that the Nakamura, Barski and de Queiroz 
references do not disclose or reasonably suggest each element as recited by the Applicants in 
independent claims 1 and 11, from which claims 4, 5, 14 and 15 depend, and the Applicants 
respectfully request the withdrawal of the rejection under 35 U.S.C. 103(a) of dependent 
claims 4, 5, 14 and 15 for the same reasons. 
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Conclusion 

In view of the above, it is believed that the application is in condition for allowance 
and notice to this effect is respectfully requested. Should the Examiner have any questions, 
the Examiner is invited to contact the undersigned attorney at the telephone number indicated 



below. 



Respectfully submitted, 




Ronald S. Grubb 
Reg. No. 48,672 
Attorney for Applicants 




Roylance, Abrams, Berdo & Goodman, L.L.P. 
1300 19 th Street, N.W., Suite 600 
Washington, D.C. 20036 
T: (202) 659-9076 
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